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Abstract. - 

This letter reports on a new method of analysing experimentally gained time series with 
respect to different types of noise involved, namely, we show that it is possible to differenti- 
ate between dynamical and measurement noise. This method does not depend on previous 
knowledge of model equations. For the complicated case of a chaotic dynamics spoiled at the 
same time by dynamical and measurement noise, we even show how to extract from data the 
magnitude of both types of noise. As a further result, we present a new criterion to verify the 
correct embedding for chaotic dynamics with dynamical noise. 



Introduction. - Handling noise in experiments is a challenging task for an experimenter 
during everyday work regardless of the field he or she is working on. Any knowledge of the 
nature of the involved noise is important to understand experimental results. It may help to 
estimate the achievable precision to make out noise induced effects or to set up models for the 
experimental system under investigation. For a general application it is essential that these 
methods should require as little knowledge as possible of the system. 

In this paper we present evidence that it is possible for measured data, which were spoiled 
by different types of noise, to separate two basic types of noise and to measure their magni- 
tudes. To show the quality of our method we apply it to the case of a noisy nonlinear chaotic 
dynamical system. Obviously, this method also works for simpler dynamical situations, which 
are frequently given in experimental research. 

Before the early 80s complex, disordered systems were explained predominantly by stochas- 
tic models. The complex behavior of the dynamic was described by random motions. Then it 
became clear that many of these disordered systems might be generated by low dimensional 
nonlinear deterministic dynamics. For both kinds of systems a lot of refined methods for data 
analysis were developed, cf. m21El^|Sl|Sl[7|[8, . Complications in the data analysis based on 
this clear distinction arise if noise is present beside a nonlinear deterministic dynamics. Two 
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basic types of noise can be distinguished, namely, dynamical noise, which acts directly on the 
dynamics, and measurement noise, which is only added to the signal of the dynamics. Thus, 
for the analysis of disordered systems it is one fundamental problem to characterize the type 
of noise and to quantify the amount of noise. 

Recently, a method was proposed whereby dynamical noise and measurement noise can be 
measured very precisely, if the dynamical equations are known [H]. Our paper is devoted to 
the problem of unknown dynamics. It is our intention to show that it is possible by pure data 
analysis to clarify which kind of noise is present. Furthermore, by using the theory of diffusion 
processes one is able to estimate the magnitude of dynamical and measurement noise. Our 
proceeding is based on recent works 0j,22j2JLJAi showing that it is possible to reconstruct 
from given data the underlying stochastic processes and we want to point out that it is not 
founded on any previous knowledge given by models of the dynamic or by some assumed 
parameterizations. 

The structure of the paper is as follows: First we describe the mathematics we are using 
for the reconstruction of the deterministic flow in phase space from given data sets. Next it 
follows the criterion for the distinction between measurement noise and dynamical noise. We 
demonstrate that this method can be successfully applied to measured data of the chaotic 
Shinriki oscillator, which are perturbed by different types of noise. At last we show that the 
signal of the dynamical noise and its correlation can be extracted from the measured data. 
This can be taken to examine the nature of the stochastic process and to verify the sufficient 
high embedding of a chaotic noisy system. 

Concepts of stochastic processes. - Based on the mathematics of diffusion processes it has 
recently been realized that by directly using the definition of the Kramcrs-Moyal coefficients 
|10[lll| it is possible to reconstruct the dynamics of the Langevin equation from given data 
pn il2lli;^lll4| . This idea is the foundation of the following presentation. 

First we focus on the wide class of nonlinear dynamical systems with dynamical noise, also 
known as the diffusion processes. It can be represented by a Langevin equation (in the Ito 
representation) , 



where X(t) denotes the time dependent n-dimensional stochastic state vector. The drift coef- 
ficients, -Dp\ represent the deterministic part of the dynamics, and the diffusion coefficients, 

(2) 

D\j\ determine the strength of the dynamical noise, including the general case of multi- 

plicative noise when the coefficients D-^ depend on X. Tj(t) is (5-correlated Gaussian noise 
(Langevin force). 

As known from ^U], the drift coefficients D^^^ are obtained as the limit of conditional 
moments M^^^ 
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M^f{^,M) = {{X,{t + M)~xdt)){X,{t + ^t)~x,{t)))\^^^^^^. (5) 

The numerical estimations of these conditional moments are performed for X(i) e t^(x), for 
a sufficiently small neighborhood f7 of a fixed value x in the phase space. These conditional 
moments can be estimated directly from given data sets in a parameter free way. For small At 
(i.e. smaller than the recurrent time ^S]) the first two moments M'^'^ [i — 1^ 2) are connected 
to the diffusion coefficient jl7[|18j : 

M\f{-K, At) - Aff ^(x, At)M]')(x, At) = D^f{x)At + 0{At'). (6) 

If, in addition to the dynamical noise, also measurement noise is present the procedure 
of the estimation of (x) has to be changed. The measurement noise, which is typically 
added by the process of measuring data, can be formulated mathematically as 

Y^{t)^X^{t)+a^Q{t). (7) 

The vector Yi is the sum of the state vector Xi described by the dynamics of Eq. ^ and 
measurement noise. Here the measurement noise is given by its standard deviation ct^ and the 
(5-correlated noise term As a consequence of the definition Q, it is easy to see that for y 
the conditional moments, as defined in Eqs. Q and l^), one obtains 

(y,Ai) := Aff (y,At)-Mf'(y,At)Mf)(y,At) 

= Z?g^(x)Ai + 2af% +0(At2). (8) 

Note that for the determination of d'^^\-x.) via Mj^^\y) (see equation (|3Jl) no correction term 
appears due to the measurement noise, because it averages out. 

The equation (jSJ is valid for a sufficient small neighborhood J7(x) so that M^^^ and Aff^^'' 
can be approximated by constant values in U{x). Furthermore the linear dependence of if 
on At can be taken as a criterion for a correct sampling frequency, which has to be chosen so 
high that this linearity is resolved. 

Next we apply the method to measured data of a chaotic electronic oscillator. As a circuitry 
we have chosen the Shinriki oscillator |2J| as shown in Fig. In Fig. |21exemplary phase space 
representations of the attractors for the measured data are shown. Fig. shows the pure 
deterministic chaotic dynamics. Fig. ^p) the dynamics with dynamical noise, and Fig. [5];) 
dynamics with the combination of dynamical and measurement noise. For an experimental 
realisation of the dynamical noise, a (5-correlated noise source is in series connection to the 
negativ resistor. The corresponding Langevin equation for the three voltages Xi, describing 
the Shinriki oscillator, see Fig. ^ are given by 

. _ X,-T,{t) Al /(A1-A2) 

= .gi(Ai,A2) + /iir(i) 
A2 = -^^^^7 - = 52(Ai, A2, A3) (10) 

A3 - -:^(A2-A3)-<?3(A2,A3), (11) 

where hiT{t) describes the Langevin force. For the specific parameters see Fig. ^ the negative 
resistor Rjq = — 6.8fcr2 and /(•) describes the nonlinearity of the Zener diodes. An empirical 
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Fig. 1 - Circuitry of the Shinriki oscillator. The noise source placed in series to the negative resistor. 



formular for the characteristic curve is 

/(F) = ( sign(V^)(^(An(A^)'+^(A^)' + ^(A^^)') ifAl^>0 ^^^^ 
1 gIsg 

where AF = \y\ — Vjy. The four parameters A, B, C and Vjj have to be fitted on the 
measured characteristic curve. Additional measurement noise was added to the data, namely 
to the component Xi. 

To give evidence of the validity of our procedure for the case of dynamical noise, we 
show in Fig. 13 the reconstructed deterministic part of Eq. Q , which we obtained from 
measured data (here and in the following we use 400.000 data points for our analysis). Here 
an exemplary cut through {D^-'-^X} has been chosen in such a way that the nonlinearity 
becomes obvious. By measuring the electronic elements {Rn, Ci, Ri and /(•)) we can directly 
compare the characteristics gained from Eq. ^ with the reconstructed one (see Fig. O. The 
small deviations can be explained by parasitic capacitances and inductances. For analogous 
numerically generated data sets no significant deviation of the reconstructed values of D^^^ 
was found. 

Furthermore, we investigate the diffusion coefRcients. For simplification, only the case of 
additive noise is considered, i.e. D'^^^ is constant. According to equations (Q, (O and © 
we calculate K^'^'>{At). To improve the statistics we calculate the median of K^^^^ (At) about 
the whole state space. As shown in Fig. 01 the moments K^^'' display a linear dependence on 
small At 52] . The slope of this dependence gives the strength of the dynamical noise 
see Eq. (jHJ. Most remarkably K'^^'^ shows an increasing off-set when the measurement noise 
is increased. According to equation JSJ with the value of K^^^^lx, At = 0) the strength of the 
measurement noise ct^ can be measured. Our results are summarized in tabled The precision 
of these results obviously depends on the number of data points. Furthermore we notice that 
with increasing magnitude of the measurement noise the value a gets underestimated while 
the precision of the estimated -D*^^-* almost remains about constant, (a = 0.24 corresponds to 
about 4% noise.) 

An important consequence of this method should be noted. In the case of pure dynamical 
noise it is easy to see from Eq. that the knowledge of Z?^^) and I?^^-' makes it possible to 
extract from measured data the noise term T{t). Based on this, it can be quantified whether 
the noise is 5-correlated or not. As an illustration the autocorrelation of the reconstructed 
noise is shown in Fig. 5a). Note that correlations are expected if the inserted noise is not 
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Fig. 2 - Trajectory for the Shinriki oscillator in the phase space with different kind of perturbing 
noise, a) without noise, b) with dynamical noise ([%/ _D(2)]ii=7.9 Y/y/s), c) with dynamical noise 
(like in part b)) and measurement noise (a=0.12 V). 




Fig. 3 - The experimentally estimated drift coefficient D^^ {Xi , X2 = 0) of the Shinriki dynamic with 
error bars. Broken curve - measurement of the corresponding circuit elements. 

Table I - Values of the measurement noise a and the diffusion coefficient as adjusted in the 

experiment and estimated from the measured data. 



a [V] adjusted 0.0 0.12 0.24 

a [V] estimated -O.OlliO.Ol O.lliO.Ol 0.20±0.01 



VL>(2)ii [V/^/s] adjusted 7.9 7.9 7.9 

VD(^'>ii [Y/y^] estimated 8.4 ±0.3 8.5±0.3 8.4±0.3 
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At [ms] 

Fig. 4 - The second cumulant K^"^^ i^t) of Eq. ^ for the Shinriki oscillator perturbed by dynamical 
and measurement noise. The different sets of data are obtained for increasing amplitudes of measure- 
ment noise (bottom up: a —0, 0.11, 0.2 V). The straight lines show linear fits, from which the slope 
(D''^-') and the offset (2a^) are obtained. 

^-correlated. To investigate such a case we use a too low dimensional phase space embedding 
of our measured data. In Fig. 5b) the autocorrelation of the reconstructed noise is shown for 
the case that the data of Fig 5a) are reduced to a two-dimensional projection of the dynamics 
on Xi and X^. In this case the unresolved variable X2 together with Fi represent correlated 
noise. This result clearly shows two points: (a) the validity of a Markov process (i.e. the noise 
is ^-correlated) can be verified; (b) if correlations are found, like those shown in figure 5b), 
the system does not obey a Markov process. 

To conclude, in this paper we show for the first time, that based on the well known theory 
of diffusion processes, and especially based on the estimation of the Kramers-Moyal coefficients 
it is possible to analyze the kind of noise given in time series. The method shown here does 
not depend on previous knowledge of the underlying nonlinear deterministic dynamics. This 
does not imply that our method must work for any dynamical process. From an experimental 
point of view, the obtained results have to be verified whether the correct dynamics is grasped 
by the reconstructed process. Therefore the acting noise can be extracted and the typical 
dynamics can be obtained by numerical integration of the reconstructed phase flow using 
the obtained values of D^^\ If this is successful, a further improvement of the estimation of 
the reconstructed process can be achieved by parameterizing the results of our method and 
successively applying procedures for parameter estimation like pill6|. 

* * * 

Helpful discussions with S. Siegert, Ch. Renner, H. Kantz as well as the hospitality of the 
Max-Planck Institute for the Physics of Complex Systems, Dresden are acknowledged. 
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Fig. 5 - Autocorrelation function of reconstructed dynamical noise, a) correctly embedded sho-wing 
5-correlated noise, b) the projected dynamics in the two-dimensional phase space X\(t) and X-i,(t), 
showing finite time correlations. 
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